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ABSTRACT 


A procedure is developed which can be used to obtain the 
solution of a two-sided allocation problem with payoff of the 
form I = sp K(x,y,tjdt if K is concave in x(t), i.e. sm < 0, 
and convex in y(t) for all t in the interval [a,b]. A 
second degree polynomial example is explained in detail to 
jllustrate the procedure. The computer program and a sample 
output for this example constitute the Appendix. Next an 
exponential search problem is discussed, Then in conclusion 


a general application of the method is outlined. 
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i. #mtroduction. 

The purpose of this thesis is to investigate a method for 
obtaining the optimum solutions of two-sided allocation probe 
lems, <A two-sided allocation problem is one in which there 
are two sides allocating resources with opposing interests. 
Generally one side can optimize its position by minimizing 
some factor, such as K dt where each side has some control 
of K, which the opposing side would like to maximize, or vice 
versa. 

The problem of maximizing (or minimizing) a functional 
53 K{y(t)] dt over a certain class of functions fy(t)} has 
been studied by use of various methods, Among these are the 
use of Lagrange multipliers[2, 9], techniques of calculus of 
variations[1, 8], and methods of control theory[3] such as the 
differential methods used in this paper. 

There appears to have been little application of these 
methods to the two-sided allocation problem where K is a 
function of two functions, x(t) and y(t). Although the theory 
of games has application to this type of problem if K(x,y,t) 
is a real valued function that is convex in y, i.e. Ky 2 0, 
and concave in x[6], it does not provide a method for obtain- 
ing a solution. The subscript indicates partial differentia- 
tion with respect to the corresponding variable. 

Until the last five years there did not exist a method 
which could be used to obtain the solution of optimization 
problems subject to constraints on resources. However, differ- 
ential methods such as those used by Faulkner[3] have been 


Es 
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developed recently which can solve such problems. A method 
for determining solutions by differential equations using an 
analog computer has been developed by Kose[4]. 

A version of the differential methods given by Faulkner 
[3] will be used in this thesis. These methods not only seem 
Simpler to grasp and apply to the particular functionals con- 
sidered, but they provide a method for solving either maxi- 
mization, minimization, or minimization-maximization (saddle 
value) problems with a speed and simplicity that none of the 
others (with the possible exception of Kose[4]) seem to have. 





e. Basic principles. 

Consider a functional of the form 
(1) t= 92 16 ale 
where: K = K(x,y,t) is a real valued function; x = x(t) is a 
function to be found which maximizes (1) subject to 
(2) x>O and fPxdt=1; 
and y = y(t) is a function to be found which minimizes (1) 
subject to 
(3) y>O and §sPyat=1. 
A function x, or y, which is piecewise continuous in [a,b] 
and satisfies (2), or (3), will be called admissible. If the 
total resources available to each side are not unity, they 
can easily be normalized to comply with (2) and (3), making 
the functions x(t) and y(t) density functions which indicate 
relative allocation of resources, 

It will be convenient to intreduce a new functional, J. 
Let H = K + Ax +ay where A and yw are constants (Lagrange 
multipliers) to be found. Let 
(4) gee §? mat. 
We see that if x and y are admissible functions, then J dif- 
fers from I by the number A +m. 

Now if y were a given function we could get a maximum 
value for J, 


J(Xo,y) = maximum J(x,y) 


by maximizing the Hamiltonian. H, subject to the constraint 

x > O, for each value of t on the interval [a,b]; however 

the function x(t) might not be admissible. Also, for given 
3. 





x(t) we could get a minimum 


J(Xy¥o) = min mum J(Xsy) « 


It should be pointed out that the functicn x9 above depends 
on both y(t) and the parameter A, and yo depends upon x(t) 
and MA. Observe that also 

(5) J(Xs¥o) < I(XoxVo) < I(Xoyy) 

since by the way it was obtained x, maximizes J(x,y) for any 
given y, even Yo, and yo minimizes J(x,y) for any given x, 
even Xo. 

If the functions Xp and yo are admissible, we will call 
them the min-max strategies cay) and we will call bros) oD 
the min-max solution. Hence, to solve a min-max problem we 
want to determine, for some A and “ initially unknown, 
J(X95Yo) Subject to the restrictions (2) and (3) on x(t) and 
y(t). Any pair of admissible functions (x*,y”) which fur- 
nishes the min-max solution of (4) will also provide the min- 
max solution of (1) since 
(6) y= fPHat = §P(K +Ax +ay)at = 1+ (A +m). 

Let us assume that K has continuous second derivatives. 
Then notice that an absolute maximum (or minimum) which is 
not a stationary point can only cccur at x =0 (or y = 0) for 
admissible functions, If an absolute maximum occurred for 
xX = X,; > O, then any larger value of x, Say x = xk, + €, would 
yield a larger value of H since Hy > O at x,. A Similar argu- 
ment applies to minimization over y. Therefore for a min-max 
solution to exist, the functional K(x,y,t) must not be mono- 
tone increasing in x or monotone decreasing in y. 
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if the second derivatives of K are continuous, then the 
following conditions exist. To get maximum H al avgeint on 
the interval [a,b], either there is a relative maximum for 
which 
C7) he boone A = 0 


or else, if the maximum occurs on the boundary then 

(8) x = 0, 

Similarly for oe a H, either there is a relative minimum 
for wine h 


(9) H, = Ky += 0 


or else, if the minimum occurs on the boundary then 
(10) y =0. 
An indication of a boundary situation will be negative values 
of x or y as solutions of equations (7) and (9). 

A min-max problem may also be called a saddle value 
problem if the integrand is strictly concave in x Oe < 0) 


and strictly convex in y (K.. > 0) on the interval [a,b]. 


Uy, 


According to Kuhn and Tucker[5] the conditions 
H,(X05Yo) gO; HX 5¥o) Xo = O; Xq 2 O 
C17) 
2 


H. (Xo Yo) 2 0; H (Xo sYo) Yo Os Yo 2 O 


are necessary in order that (x9,Y.) provide a solution for 
the saddle value problem, which neatly summarizes the previous 
two paragraphs. 
If the function K is not concave in x and convex in y 
the possibility of multiple soluticns of (7) and (9) arises. 


In this case the difficulty of computation increases consider- 


or 





ably. Each possible pair of roots (x,y) must be checked to 
determine the x which maximizes H and the y which minimizes 
H. This operation must be repeated for each value of the 
parameter +t on the interval [a,b]. 

Only the simple case where K(x,y,t) is strictly concave 


ag) 2. Ke < O,gandsstriculy convexgin y wei > 0, cover the 


y¥ 
domain [a,b] of the parameter +t will be considered further. 
Differentials will be defined and a Newton-Raphson iteration 
set up to determine the desired solution. 

While we had no trouble with convergence, this is often 


a problem when using a Newton-Raphson iteration procedure. 





3. Computational procedure. 

In this section we will set up a Newton-Raphson iteration 
for the solution. To start, let us guess values for the La- 
grange multipliers A and ~ and compute a trial solution for 
x(t) and y(t) using equations (7), (8), (9) and (10). Usually 
it will not be an admissible solution since 


b 
Ja 


b 


xdt=X 71 and fy dt 337 a 


But we shall see that if the solution thus found is, by rare 
good luck, admissible, then we have the min-max solution. 
This follows directly from (5) since any trial solution is 
(Xo,¥o) for the particular values of A and { chosen. 

Let us now set up a routine for correcting the values of 
(X,Y) obtaining a sequence approaching (1,1). Suppose we con- 
sider the given trial solution and neighboring values of % and 
Ms Say A + da and w+ du. Every optimal solution must satisfy 
H,(X0,¥o)Xo = O and Hy (Xo s¥o)¥o = 0 from equations (11). Gen- 
erally only one of the terms in each product is zero at any 
point on the interval [a,b]. If these zero terms are con- 
strained to remain zero as we change x, y, A and mM, by small 
amounts dx, dy, dA and du, then x and y must always maximize 
and minimize, respectively, H since the requirements (11) re- 
main satisfied. We must change x, y, A and ~ in such a way, 
satisfying the above, that the values X and Y approach unity. 
In order to calculate 

dx = §? dx at and ay = §° dy at 
let us divide the interval [a,b] into four subsets of inter- 
vals Tp, T,, Te and Ts. On the intervals in Tp the min-max 


ar 





values of x and y are obtained from (7) and (9), i.e. x > O 
and y > O03; on those in T, we use (7) and (10), i.e. x > O and 
y = 0; on those in Ty we use (8) and (9), i.e. x =O and 

y > 0; and on those in T3 we use (8) and (10), i.e. x = O 

and y = 0. The resulting variations 6x(t) and dy(t) will be 
given in the intervals of To by 

O = OH, aie Ox + Hy dy + ar 


(12) 


O = JH, =H, dx + H, dy + au. 


In the intervals of T, they are given by 


O = dH. = H.. dx + dp) 
One dy. 


since y = 0 on these intervals. In the intervals of T. they 


are given by 


O = bx 

(14) 
nl = a 
OH, Hyy dy + da 

Since x = 0. Finally in the intervals of Ts 
as on= Ox 
15 s 

Q = by. 


Hence we have equations of the form 
pameueox * b,.(t) oy + dA = 0 
bei(t) dx + bee(t) dy + dA= 0 
which can be solved for 
Gex(t) ai4(t) dA + ayo(t) du 
Oy(t) = agi(t) GA + agn(t) da 
where the a,.'s are obtained from (12), (13), (14) or (15), 


ij 
depending on the interval. 


(16) 


(17) 


We are now ready to calculate the total effects, dX and 


Ss 





d¥, of the small changes dx(t) and dy(t). Integration over 
the entire interval [a,b], consisting of the four subsets Ty, 
T,, Tz. and Ts, yields 

aX = Ayy dA + Aye du 

ay 


(18) 


Ao4 dA + Ago CMA 
where 


dx 


s> dx(t) at, ay = §? dy(t) at, 
_ ob 
A, = 4s ay 3%) ait 


Now let us treat the differentials in (18) as differences to 
get 

Ay, AA + Ayg AM=AX=1- X 
aks) 

Ao, AA + Agg Au = AY =1- ¥. 
These equations (19) can now be solved for AX and An; thus we 
determine new values of A and 4“ which tend to drive the solu- 
tion toward admissibility. 

Let us repeat this. We compute another trial solution 
using the new values of A and “4. Repeat this sequence until 
the "errors" dX and dY¥ become sufficiently small and the 
solution is admissible, within the required accuracy. 

It is convenient tc define an error term which can be 
used to check the convergence toward admissibility. Let the 
error, k, be defined as 
(20) B= (la Kk) oe (an) > See 
As the error goes to zero the solutions approach admissibility 
Since both X and Y must be approaching unity and the differ- 
ences, AX and AY, must apprceach zero. 


An important feature of this differential method is that 
9. 





each solution is an optimal (maximizing and minimizing) solu- 
tion for the particular values of A and mw, or endpoints X and 
Y, considered. The successive iterations drive Xp and Yo to 
admissibility, thus yielding the min-max (or saddle value) 


solution which satisfies the given constraints (2) and (3). 


10. 











4. Second degree polynomial examples. 

In order to test the methcd a computer program was 
written, using FORTRAN language, and run on a CDC 1604 com- 
puter. The form of this program and a sample solution, which 
will be explained in detail, appear in the Appendix. The 
program was set up first for an integrand of the type 
(21) K(x,y,t) = (y + At +B)“ + xyt - (x + Ct + D)*, 

The parameters A, B, C and D were assigned various sets of 
integer values to test the general applicability of the 
method. In every case the interval [a,b] was chosen to be 
Og tle 

The choice of initial values of the Lagrange multipliers, 
A and “, is at times a minor problem in getting started. If 
the initial values yield only negative values of x(t) and y(t) 
over the interval [a,b], as determined by equations 
(7) Shee 1 A = 0 and 


x 
(9) H = KL +a= 0, 
then the procedure has no way of determining appropriate 
changes, AA and AM; of the Lagrange multipliers for a new 
iteration since each of the A,4'§ in equation 
a dX = Ay, GA + Ayn Aa 

GY = Agy dA + App aK 
will be zero. The solution of equations (7) and (9) at any 
point on the interval [a,b] with the requirement that both x 
and y be poSitive at that point should indicate appropriate 
initial values of A and m such that convergence and a solution 


Will occur. 


1 





Now let us go through the method in detail for a specific 
(22) K(x,y,t) = (y + at)’ + xyt - (x + 3t)*. 
The Hamiltonian, H, is 
(23) H = (y + at)" + xyt — (x + 3t)% + Ax + wy 


and its second partial derivatives are 


fey = t= Roy 
(24) Hx = -2 = Ky < © 
H = e2=k 0 
es vu, a 


The first partial derivatives of H are 


H, = -2x + ty - 6t + y 

(25) 
H = tx + 2y + 4t+y, 
y * ee 4s 


we can see that K is strictly concave in x and strictly convex 


in y from (24). Upon setting ahs = i = © we can solve for 
Ze 
Ge -4t" - ies = Mt + 2h 
t” +4 
(26) 


Geaest eaten 
t< + 4 


Ef 


y(t) 


Recall that the maximizing function x = Xp and the minimizing 


function y = yo satisfy 


Mout xt G) i o'd Wire) a2 8) 
= QO tf .XCG) <0 
Yo = y(t) ie yy Gby: SO 
= 0 ea cea 


when x(t) and y(t) satisfy equations (26). 
To determine appropriate initial values of A and w« in 
this problem, evaluate (26) at a particular value of t, say 


t = 0. Then x(0) = 0.5A and y(O) = -0.54, and any values of 


es 





A> O and “< 0 are satisfactory for an initial guess, If we 
take A = 10 and “ = -10, then x(0) = 5 and y(C) = 5. 

Let us arbitrarily divide the interval [0,1] into 100 
equal parts of length 0.01 and calculate x(t) and y(t) by (26) 
MOEN = O5,O.01,°0.0c. © = = , O29 OU. a Me amin emyic 
should determine which of the four subsets of intervals, Ij, 
T,, TI. or T3, we are in for each value of t in order to cal- 


culate the a..'s which are necessary for the determination of 


LJ 
AA and Au if the solution is not admissible. The a,4's are 
Bivens e sam ly (x > Os y > 0) by 
- K K. 
_ y¥ =. ey oa 
wo) = a 2 5 3 Aaig(t) = ee K D9 
xxtyy ~ Axy Xx yy “xy 
(27) 
K = K 
ee ks ae = i rr ae 
agi(t) = ¥ = ee @g2(t) = ae _ 5 3 
xx*yy 7 Sxy XxX yy xy 
emi eae Oy Y ae ©) bY 
a134(t)= A 9 
(28) KK 
Aayo(t) = ao4y(t) = age(t) = 0; 
ie io\ x =—mOen y > O) by 
aii(t) = age(t) = aga(t) = 0, 
(29) a 
@g_(t) = 7 § 
MANE 
and in Ts (x = 0, y = 0) by 
(30) 44 t) = Aie(t) = Ao,(t) = Aoo(t) = 20% 


For this particular example we find that Tp = [0, 0.82], T, 
is empty, To = (0.62, 1.0] and 2, ie -empty. 


Let us integrate xo(t) and yo(t) using a trapezoidal or, 


ee 





if more accuracy is desired, Runge-Kutta method to determine 
if they are admissible, i.e. they integrate to unity. They 


are not admissible since 
i = J = 
So Xo dt = 4,1225°** and So Yo dt = 3,.0644°°°, 


For each value of t on [0,1], a change in x, y, A and y% ac- 
Cordine suo 

Ox = @4, GA + age Asi 

dy 


will retain the maximizing and minimizing properties of x,and 


(17) 


ao 4 an oy aeo AL 


Y: The total changes over the interval [0,1] are 


de = Aai4 aA = Aio da 


(18) 
ay = Ao, aa T Ase da 
where 
ax = (+ dx at ay = 5+ dy at 
_ O ’] Ss O Ve 9 
| opal 
as So as j ce 


For first order approximations treat the differentials as 


differences anc set 


Be = 1 = X= App AX th Ay A = eae Zoe 

AY = 1 - Y = Agi AA + Age Au = -2.0644++>, 
Solve for 

AA = -5.3532° °° 


Af = 5.7408e°°, 
Repeat the calculations of x and y by (26) with 
A = 4,6468°°= 
fa =-4,059e°*", 
Continue the routine and repeat until AX and AY are acceptably 


ia 





small. 


Other polynomials solved by this procedure were: 


[1 + (t - Ss) Iy~ + xyt - x”, 


(31) KGa yin &) 


(ae) K(x,y,t) = y“sin(t) - xycos(t) - x”, 


The last one was solved for the interval [0,1] and also the 
interval [0,7]. Care must be taken to ensure that the inte- 
grand, K, maintains its strictly concave, strictly convex 
properties over the entire interval. The interval {0,2r] 
cannot be used for (32) because Ky = 2sin(t), which becomes 


negative on the interval [1,27]. 


rs 





5. Exponential search example. 
The particular functional which kindled interest in the 


two-sided allocation problem was the integral 


5 igieemem=” ede 

which represents the probability of detecting an object dis- 
tributed as x = x(t) over the interval [a,b] by use of a 
search effort distributed as y = y(t) over the same interval 
if the law of detection has the exponential-saturation form 
as in random search[7, 9]. The function g = g(t) is a measure 
of the ease with which a unit of search conducted near t 
detects a target there and is considered known. For "stand- 
ard" conditions, g may be considered unity. 

To maximize this integral with respect to y it is neces- 


Sary to minimize over y 


(33) T=f§- xe! at, 


This problem was posed and a method of solution given in 
Search and Screening, O.E.G. Report No. 56[9] and in a paper 
written by Bernard 0. Koopman[7] who edited the above report. 


However, the maximization over x of 
b wee 
ee i xe at 


was not considered. 

Notice that this problem does not meet the requirement 
of strict concavity in x since a = ©. However the differ-= 
ential method produced a min-max solution and min-max strate- 
gies with no difficulty. Minor modifications to the FORTRAN 


program listed in the Appendix were made to fit it to this 


VEG. 
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problem, The function g was assumed to be of the form 


2 x) 


g = A+ Bt + Ct + Dt 
and required to be strictly greater than zero. The parameter 
A was given the values 0.01, 0.1, 1, 3 and the other parame- 
ters were either all zero or else one was set equal to +0.9 
until 17 different problems were solved. The smallest and 
largest values of g were 0.01 and 3.0. The number of itera- 
tions required to drive the error less than gee was never 
more than six, The program compiled in 47 seconds and required 
about 10 seconds to complete a single solution. 

It became apparent that this particular problem could be 


solved more easily than by the differential method used, Con- 


sider the Hamiltonian 


H= xe © + \x + wy. 


To minimize H over y(t) we solve 


H = -8x e BY + H= 0. 


We may solve for y, obtaining 


(34) y(t) = So ee if g(t)x(t) >“ 
7© if g(t)x(t) < AZ. 


This is the solution obtained by Koopman[7, 9] for any fixed 
function x(t). We must also maximize H over x(t) and hence 
we have a second equation 
= 9 SY = 

HH - & a ae Oe 
We must solve these simultaneously for x and y. We require 
then 

ae me 
y(t) = BCty 1Be 27 
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or g(t)y(t) = constant. From (34) we see that gx must also 
be constant if gy is to be constant. Due to the requirements 
for admissibility it follows that 


x(t) = y(t) = airy 


where fT is a constant to be determined, If the constant Y is 
assigned any reasonable positive number, one iteration will 
be sufficient to determine the min-max strategies (x*,y”) 
since the initial solution (X9,yY,q) can be made admissible by 


normalizing it. For example if 


b b 

§, Xo dt = X= $2 Yo at 
then 

Be xACe) Lan OD Bee) 

i ¥ dt=1l=$, xX Get 
and 


GE). = Foi =i ae 


All that remains is to show that the solution attained 
is truly a min-max solution in that x* and y* are min-max 


strategies, Consider the payoff 
% 
eceny) = e x*e8Y at = - ed ee 
Observe that if gy” remains constant over the interval [a,b] 


then for all admissible x we have 


i@,y ) = sP-A x(t) Go = ey) =e ye 


Since the integrand, K, is strictly convex in y (K_. > 0), it 


yy 
is obvious that for all admissible y(t) 
Ceo) < Se 
If x = x,(t) # x*(t), then there exists a y,"(t) such 


Tes 





that 
E(xa377 ) < I(x",y") 

and x # x*(t) obviously does not maximize I. In conclusion 
inex e ) < Leayy ) = Mice, << nie) 

and (x*,y™) is a min-max strategy. 

As a rough check to ensure that x” was a maximizing stra- 
tegy, equation (34) was used to calculate the minimizing stra- 
tegies y™ for predetermined non-optimal strategies 

x(t) = 1, 

mete 0,05 + Lon 

x(t) = 1.95 - 1.9t, 
letting g(t) vary as in the min-max calculations previously. 
In every case the min-max solution payoff was greater than 
the minimizing solution paycff when x was fixed not equal to 


x” (te 


19, 





6. CeEnclusi ens. 
Maes ditieraential metnodcs discussed in this thesis sean pe 


used to determine 


b 
max min §, K(x,y,t) dt 


subject to 

Sor” heats x 
(35) 5 

y>O0, ee 


where X and Y¥ are given numbers and the integrand has certain 
properties. It must not be monotone increasing in x or mono=- 
tone decreasing in y, for x and y large, over the interval 
[a,b]. The integrand, K, is assumed to be finite and real 
valued although it need not be continuous as iong as the 
regions of discontinuity are known, Determination of maxima 
and minima is accomplished by comparison of the value of K at 
stationary extrema with its value at the discontinuities. 
This thesis specifically covers the cases when K is twice 
differentiable, strictly concave in x (K,, <0), and strictly 
convex in y (Ko > 0) for non-negative piecewise continuous 
x and y over the domain [a,b] of the parameter t. For this 
type of fvmetion, K, a min-max solution, 1(x (t)s0y Cs) need 
a min-max strategy (x*(t), y*(t)) can be determined which 


Sauusty the constraints (35). 


20% 
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APPENDIX 


First the symbols and terms used in the FORTRAN program 


will be correlated with those introduced in the text of the 


thesis; then a brief explanation of the program, the program 


itself, and a sample output will follow. 


FORTRAN 
symbols 


T 


XM 


YM 
FUNF 
FXYF 
FXXF 
FYYF 

A(1,1) 
eTOT( Ine) 
U 
V 
neon 
NAY OME 
EG) 


DX 
Di 
DU 


Text 


x(t) 

y(t) 
dx 
oy 
aa 


Explanation 


the independent variable defined on 
the interval [0,1] 


that x which maximizes H where 
H=K +Ax + “wy 


that y which minimizes H 

I = ~ K dt where K = K(x,y,t) 
a*K/axdy 

6°K/3ax* 

a“K/ay* 

from equation (17) 

from equation (18) 

Lagrange multiplier 

Lagrange multiplier 

(sens 

5. Yo dt 

a particular value ot st ommloniy 
a solution of equation (26) 

a solution of equation (26) 

a small change of X)(t) 

a small change of yo(t) 


a small change of A 


Zens 





FORTRAN 


symbols Text Hp lanetrer 
DV duu a small change of “ 
DIFFX ax 1 = Six at 

DIFFY ay l= § Yo dt 

eon I(x,y) SK at 


Items set off by a brace of CCCCCC's will generally 
change when the integrand, K, is changed. 

After the maximum number of iterations, division of the 
interval [a,b], acceptable error and initial Lagrange multi- 
plier values are determined, we commence the iterations. The 
interval [a,b] has been chosen to be [0,1]. The variable T(I) 
is defined in such a way that it takes on values from Zero to 
one as the index, I, goes from 1 to 101. We now solve the 
first derivative equations (26) for X and Y, and determine 
which set of subintervals, Ts, Ts, T,; or To, we are in so that 
XM, YM, A( 1,1), A( 1,2), A(2,1) and A(2,2) may be determined. 

Since we are uSing a trapezoidal integration routine, we 
sum XM, YM, A(1,1), A(1,2), A(2,1) and A(2,2) as we calculate 
them and then multiply each total by the width of one inter- 
val, At, to determine the integrals, After the error is 
determined, pertinent values are printed and then if the solue- 
tion is not admissible, within the acceptable error, changes 
of the Lagrange multipliers are computed using the subroutine 
at the end of the program. The iterations are repeated until 
the error is acceptable and the solution XM, YM is admissible. 


The payoff is now calculated using again the trapezoidal 


om 





integration method. The min-max solution (PAYOFF) and min- 
max strategies (XM, YM) are now printed, 

Statements 150, 140 and 135 are used only if poor ini- 
tial values of the Lagrange multipliers are chosen such that 
the matrix ATOT is singular (i.e. its determinant is zero). 
inemprinceus 1S for information only. 

The numbers at the end of the program are sample values 


of AA, B, C and D to be read into the program as data. 
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